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I. Origin of the Disadvantaged Series 

A. Introduction 

The Disadvantaged Series was conceived in accordance with and 
developed out of the current Federal priorities, which supported the 
Center in the selection of the vocational assessment of the socially 
handicapped as its Training focus. The major thrust of the Center's 
Training activities thus will be directed towards the development of 
training materials for use in the in-service Training of all levels 
of rehabilitation practitioners. The first phase of the Disadvan- 
taged Series was the Methodological Conference; the second phase will 
be the retrieval and validation of information; and the last phase 
will be the packaging of that information into "Training packets 11 
which will use whatever media that will make the presentation of in- 
formation most effective. The Training packets will contain infor- 
mation essential for increasing the competencies of rehabilitation 
practitioners in their efforts to successfully assess the socially 
handicapped, which, as in herein defined, includes former drug addicts, 
public offenders, alcoholics, poor, and the disadvantaged. 

B. Development 

The Disadvantaged Series of developmental conferences were concep- 
tualized with these assumptions: (1) successful rehabilitation person- 
nel possess knowledge about assessment of the Socially Handicapped which 
is not available from traditional sources; (2) this information is re- 
trievable; and (3) such information is of value for use in the develop- 
ment of in-service training materials. 
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The critical assumption is that relevant information about assess- 
ment may be retrieved and extricated from experienced rehabilitation 
workers. The major tasks are then to systematically retrieve such in- 
formation, validate it, and organize what of it is essential into the 
content base from which various training materials (herein referred to 
as "training packets") may be developed for dissemination. 

The developmental conference? for the Disadvantaged Series were 
designed to provide the Research and Training Center with a variety of 
professional thinking out of which the format for the Disadvantaged 
Series would evolve. 

C. Assessment 

Since the focus of the Center's Training activities is assessment 
of the Socially Handicapped, it is necessary to have a clarified defi- 
nition of assessment which is at once theoretical and operational. 

Vocational assessment is seen as a dynamic individualized process. 
Assessment for vocational rehabilitation is broadly conceived by the 
Center to include any form of institutional operation, interpersonal in- 
eraction, individual activity, or social process that mediates decisions 
that may be related to the vocational future of actual or prospective 
clients for rehabilitative services. The broad concept arises out of 
a recognition of the diverse and numerous factors that may interact in 
complex and largely unknown ways to affect rehabilitative processes. It 
j includes but subsumes modes and techniques usually thought of when assess- 

ment is mentioned, such as vocational interest and aptitude inventories, 
work sampling techniques, psychological tests, medical examinations, and 
intake interviewing among others. 

o 
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The definition used here goes beyond the traditional idea of 
assessment to include emphasis on self-assessment and social and or- 
ganizational influences on the decision-making process. To the ex- 
tent that this definition includes a traditional outlook, it is ex- 
pert-centered; however, since the definition used here is inclusive 
of the client's perspective, it seeks also to be interactional and 
client-centered. The advantages that this enlarged definition allows 
will permit a more thorough retrieval of information about the client. 

II. Disadvantaged Series: Methodology Conference 

A. Planning 

The Disadvantaged Series is divided into three phases (See Appen- 
dix A): 1. The Methodological Planning phase* which is primarily con- 
cerned with model building; 2. The Curriculum Content Development 
phase which is concerned with retrieval, validation and organization 
of information; and 3. Demonstration Training Sessions which are to 
provide pilot Training situations for the Center's material prior to 
dissemination. 

1 . Guidelines for Model Building 

Prior to the TM9-10 conference, held in August, 1969, Dr. Leonard 
V. Wendland, present Director of the Research and Training Center, met 
with Dr. Akkanad M. Isaac, Assistant Professor of Industrial Engineering 
at the University of Pittsburgh. The purpose of this meeting was to ex- 

*It was decided, for expediency, to combine the two methodological 
conferences, TM-9 and TM-10. 

o 
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plore the possibilities of Dr. Isaac's participating as a consultant 
in the pre TM9-10 planning and in the development of a model for im- 
plementing the Disadvantaged Series. Dr. Isaac suggested that a mo- 
del of an operational system is an attempt to symbolize the salient 
features of that system. The objective of a model then is to symbo- 
lize, systematize, describe, explain and predict systems behavior. 
The model also functions, though, as an aid to detecting "unidentified" 
parameters of the operational system, and is therefore productive of 
valuable insights. Such a model would consist of a variety of: (a) 
subsystems; (b) elements of components within subsystems; and (c) re- 
lationships within and between subsystems. 

Subsequent meetings with Dr. Isaac resulted in the formulation of 
several procedures that we followed for the TM9-10 conference. Prior 
to the conference, a list of specific questions was sent to the partici- 
pants so that parameters for the meeting could be established. 
B. Participants of TM9-10 

The Methodological Conference TM9-10 was held at Hillman Library, 
University of Pittsburgh. Twelve scientists from social, psychological, 
and educational disciplines who have had experience with informaton re- 
trieval were selected. The conferees were chosen from the professional 
communi ties; they represented agencies and the academia. Each partici- 
pant was provided with pre-conference materials which included program 
objectives, procedures and operational methods, and they were asked to 
prepare written comments to the list of questions sent to them. 

A list of the participants follows: 
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Dr. Lloyd Bell 
Assistant Vice Chancellor 
Urban and Public Affairs 
University of Pittsburgh 

Jack W. Birch, Ph.D. 
Associate Dean 
School of Education 
University of Pittsburgh 

Morris L. Cogan, Ed.D. 
Chairman, Teacher Education 
School of Education 
University of Pittsburgh 

J. Steele Gow, Jr. , Ph.D. 
Associate Provost 
University of Pittsburgh 

Thomas A. Hart, Ph.D. 
Professor 

International & Development 

Education Program 
School of Education 
University of Pittsburgh 

Professor Allen Kent 

Director 

KAS Center 

Education Library Science 

in Computer Science 
University of Pittsburgh 

Mr. John McGrath 

Bureau of Employment Security 

Harrisburg, Pennsylvania 



C. Design 

The molar objective of the Methodology Conference TM9-10 was to de- 
velop a model for the retrieval of information dealing with the success- 
ful assessment of the Socially Handicapped. 
Four objectives were established: 

1. To provide guidelines for the identification of individuals 
whose experiences would most likely be authentic and unique- 
ly different from others, thus facilitating the retrieval 
of a broad sampling of potentially useful training content. 

o 
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Mr. F. Clinton McKay 
Executive Assistant 
Department of Public Welfare 
Health and Welfare Building 
Harrisburg, Pennsylvania 

Joseph Newman, Ph.D. 
Coordinator, Rehabilitation 

Counselor Training Program 
University of Pittsburgh 

Mr. David A. Ramsey 
Assistant Director 
Education and Training 
Research and Training Center 

in Vocational Rehabilitation 
School of Education 
University of Pittsburgh 

Godfrey D. Stevens, Ed.D. 
Professor, Special Education 

and Rehabilitation 
School of Education 
University of Pittsburgh 

Leonard V. Wendland, Ph.D. 
Director 

Research and Training Center 

in Vocational Rehabilitation 
School of Education 
University of Pittsburgh 

Henry Williams 

Assistant Regional Representative 

for Rehabilitation Services 
New York, New York 
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2. To provide a means for validating the relative worth and 
usefulness of written materials (Journal articles), respon- 
ses to specific questions (i.e. interview and/or question- 
naires), prepared assigned position papers or statements 
dealing with specific topics, and spontaneous comments 
elicited by group interaction and group leaders. 

3. To provide a means for analyzing and organizing materials 
into a content base for use in the development of train- 
ing materials. 

4. To provide an effective means for continuously updating 
the content base in training programs. 

Conference TM9-10 was structured to emphasize methods for the re- 
trieval of information which could then be incorporated into 'Training 
packets." The proceedings of the conference were tape recorded for 
subsequent content analysis. Dr. Wendland chaired the conference, pro- 
viding periodic input to steer the cause of the meeting. 

The four objectives of the conference TM9-10 were ancillary to and 
instrumental for the development of the information subsystem of the 
Center's training model. Two objectives of TM9-10, retrieval and valid- 
ation, were given considerable attention and therefore will be briefly 
reviewed. 

1 . Retrieval of Information 

The following sources and techniques for the retrieval of infor- 
mation were suggested by the participants at TM9-10: 

Counselors in the bureau of Vocational Rehabilitation, private 
agencies and elsewhere who have functioned with varying degrees 
of success with socially handicapped people can be identified 



and consulted. These people may not have a preconceived idea about 
the socially handicapped, but rather have developed competencies 
which they utilize in working successfully with clients. It may be 
possible to elicit useful information from these counselors. Coun- 
selors who have been interested in working with the disadvantaged 
client but with little success may be able to ask many relevant 
questions useful for analyzing and organizing information. 

The socially disadvantaged client was suggested as another im- 
portant novel source of information. The client who has been either 
successfully or unsuccessfully rehabilitated will be able to offer 
useful information relevant to the development of an authentic con- 
tent base. The potential client who has not sought or refused voca- 
tional rehabilitation services may also provide meaningful data. 

Simulation or role playing exercises constitutes another infor- 
mation retrieval technique that would bring counselors and clients 
together. The counselors arid clients would be given specific but 
different objectives previous to their encounter. Following the 
confrontation, counselors and clients would meet separately to dis- 
cuss what they felt was the other's objective during their meeting. 
These critiques may lead to the discovery of insightful new informa- 
tion. 

Collection of information directly on local sites by techniques 
like video-tape was another retrieval technique suggested by the par- 
ticipants. Observers could then analyze video-tape recordings of coun 
selors who were working with disadvantaged clients from the ghetto. 
The value of this approach is based on securing information from the 
actual environment where counselors and clients interact. 
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Action groups have been formed in some ghetto communities to fa- 
cilitate change. These groups would be asked to help develop relevant 
input. The means could be made available for both the individual cit- 
izen in the community and the leaders of various community organiza- 
tions tc provide relevant information. 

The paraprofessional who is working in the rehabilitation field 
would be another information source. Relevant curriculum content for 
training packages would be developed by interviewing these personnel. 
Their impressions of clients, counselors, supervisors and administra- 
tors woKjld be excellent sources of new information. \ 

Individuals in public and private agencies who have demonstrated / 
expertise in their work with the socially handicapped may provide rele- 
vant input. Other sources of information will be leaders of community 
organizations, indigenous people who have worked in the rehabilitation 
field as paraprofessionals , and most important prospective clients who 
have previously been involved either successfully or unsuccessfully in 
the rehabilitation process. These people could be interviewed in small 
groups or individually. It might be profitable to meet these people 
where they work so that the investigators can gather their information 
with a better feel for the authenticity of the data. 

Traditional sources of information retrieval may also be utilized. 
Written accounts of professional opinion and the recorded results of 
investigative research may be systematically retrieved from standard- 
sources. These methods were not discussed by the conferees primarily 
because such sources do not represent innovative avenues for retrieval 
of information dealing specifically with the socially handicapped. The 
professional literature is expected to be an important source of input. 

o 
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In summary, the essential function of the retrieval event is to 
gather information from broad and diverse sources. 
2. Validation of Information 

Another important component of information retrieval is that of 
providing a means for weighing the relative usefulness of written ma- 
terials (journal articles), responses to specific questions, (i.e.., 
interviews and/or questionnaires) prepared assigned position papers 
or statements dealing with specific topics, and spontaneous comments 
precipitated by group discussion. 

It was suggested that counselors who are working in the field 
will be able to judge the relative pragmatic value of materials that 
are continuously being collected. 

As was previously mentioned, the Pennsylvania Bureau of Employ- 
ment Security has been developing a program to increase counselor 
• effectiveness in dealing with the problems of the disadvantaged. The 
rehabilitation counselors who are presently working effectively with 
the disadvantaged could provide another means of validating and weigh- 
ing the relative merits of retrieved information. When a number of 
counselors agree that a particular technique has been found to be effec- 
tive, its credibility is enhanced. 

The conference members suggested that during the data collection 
process materials may be weighted by the contributors. It would then 
be useful to reconvene some of the groups and individuals who have con- 
tributed to the input so that they could help the Center weigh the rela- 
tive importance of the data that has been gathered. 

o 
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III. A Systems Model for the Recursive 
Development of Training Programs 

A. Introduction 

Conferences to be conducted by the Center are of three general 
types: (1) Training conferences of a general educational nature; 
(2) Developmental conferences to gather new information which may 
result in the production of training packets or in-house publications; 
and (3) Demonstration conferences to field-test training packets. 

Conference TM9-10 accelerated the development of the Center ! s 
training model which will form the paradigm for future conferences of 
the three types just mentioned. The model was primarily developed 
to be the vehicle for completion of the "Disadvantaged Series" (See 
Appendix A). The Center ! s training model is identified as: A Sys- 
tems Model for the Recursive Development of Training Programs . (See 
Appendix B.) A description of the training model is presented to 
enable the reader to better understand the structure and method to be 
used by the Center in its conduct of conferences. 

The present planning for years 1971 and 1972 assumes the comple- 
tion of the "Disadvantaged Series," provided that the focus on the 
socially handicapped population rsmains the major emphasis of the 
Center 1 s training activities. 

B. Description of a Systems Training Model 

A major goal of the Center is the development of training packets 
intended to increase the assessment skills of rehabilitation personnel 
in their work with the socially handicapped. In meeting the special 
requirements of this objective, a prototype Systems Training- Model has 
been formulated. This model serves as a guide to the Research and 
Training Center in the execution of its training goal. 
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The model combines the development of training content with the 
design of training packets. The word "systems' 1 connotes the importance 
of coordinating all parts of the developmental process in accomplish- 
ing the Center's training goal. An important feature of this model is 
the self -correcting mechanism which controls the quality of the output 
for each subsystem of the model. In this way, the training model is 
recursive in design; that is, the main activity of eafch subsystem of 
the model is continuously updated, refined, and revised as feedback 
data becomes available. 

, The Systems Training Model is presently conceptualized as consis- 
ting of three primary subsystems: (1) Information Subsystem, (2) Devel- 
opmental Subsystem, and (3) Evaluation Subsystem. The Information Sub- 
system gathers relevant information from various information sources. 
The collected information is validated and organized to form a content 
base. The Developmental Subsystem has the specific function of proces- 
sing information from the content base. The content base is the ena- 
bling base for the production 6f training packets. The Evaluation Sub- 
system enables the developer of the training packet to obtain data useful 
for determining the completeness and value of the training packet. The 
reader's attention is directed toward a brief characterization of the 
three subsystems of the Systems Training Model. 
Information Subsystem 

The Information Subsystem of the Systems Training Model had its ori- 
gin in the results of the TM9-10 conference of the "Disadvantaged Series." 

The Information Subsystem of the Systems Training Model consists of 
three functional components. These components retrieves validate and or- 
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ganize information forming the content base. The content base is com- 
prised of a systematic body of knowledge and skills required for mini- 
mal counselor competency. Expert judgment i§ the method used to filter 
content, both at the point where the information is received and at a 
later time determining if it has become obsolete. 

Retrieval of Information : The retrieval component of the Infor- 
mation Subsystem relies both on traditional and new sources and tech- 
niques for gathering relevant content for use in the development of 
training packets. Written accounts of professional opinion and the 
recorded results of investigative research may be systematically re- 
treived from standard sources of information. 

In addition to orthodox sources, new inputs to the content base 
may be used. Special techniques are required to elicit relevant infor- 
mation from numerous authentic and indigenous sources. Vocational re- 
habilitation personnel who are presently working with socially handi- 
capped clients in both public and private agencies are in an ideal po- 
sition to make significant inputs to the content base. Another source 
of input is the community action groups that have been formed to facili- 
tate change in their communities. "Grass-roots M workers provide valuable 
sources of input mainly because of their close relationships with and "in- 
tuitive 11 understanding of the socially handicapped individuals. Clients 
represent another potential source of novel input. The reports of both 
successful and unsuccessful client encounters with the rehabilitation 
establishment provide valuable content input. Along with this group, the 
contributions of indivuals who have not been involved in rehabilitation 
and yet may be eligible for services are also considered important sources 
of information. The strategy of meeting with people in their home environ- 
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ments,,in groups and individually, could result in the acquisition of 
a body of relevant unique information. From these sources it is ex- 
pected that a content base will be formulated which will provide the 
basis for the development of training packets and will result in the 
conduct of effective training programs. 

Validation of Information : The validation component of the In- 
formation subsystem functions in a unique way. Unlike libraries which 
make little attempt to validate information, the validation component 
filters retrieved information by accepting only useful, worthwhile 
and reliable content. 

The validation process depends largely on concurrent agreement 
among professional and non-professional personnel in vocational rehab- 
ilitation. If a considerable consensus is obtained for a given train- 
ing item, then that item is deemed worthy of inclusion in the content 
base from which training packets are designed. A training item of in- 
formation is the smallest competency-basad unit amenable for training 
purposes. A training item may be viewed as an essential skill or rele- 
vant concept. The compilation of these training items forms the con- 
tent base. 

Organization of Information : The function of the organization 
component of the Information Subsystem is to provide u systematic bod|y 
of knowledge known as the content base. A determination of the sequential 
organization of training items is made. A training item roughly corres- 
ponds to an essential skill, mastery of which is required by the trainee 
for minimal competency. Various scaling techniques combined with judg- 
ments are the primary methods employed for sequencing training items of 
information. 
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For each training item a training objective is prepared. Objec- 
tives are clustered to correspond to functions which comprise the various 
professional roles of the trainees: for example, the counselor's role as 
test interpreter is a major role requiring mastery of many training items. 
The counselor's competency as test interpreter is improved as specific 
individually prescribed training objectives are acheived. The ordering 
process facilitates the construction of both short and long term training 
packets. Individualized use of competency-based training packets (CBTP) 
provides on an individually prescribed basis training programs at the user 
level . 

Updating of Information : An important quality control measure imposed 
on the Information Subsystem is the updating event. This event is charged 
with the function of keeping the content base relevant. As the roles and 
functions of those to be trained change, the training items in the content 
base will need to be modified. Since much of the content base deals with 
training items of an exact nature, the value and worth of these training 
items will be largely dependent upon evaluative data received from the 
field. Also, in the design process where training items are synthesized 
into training packets, formative evaluative data provide content and neces- 
sary validity checks on the many training items in the content base. Thus, 
the content base remains a source of relevant training items.' 

Developmental Subsystem 

The content base, an organized body of specialized knowledge, when 
subjected to the design process of the Systems Training Model results in 
the construction of training packets reflecting sound principles of train- 
ing and learning. The Developmental Subsystem of the Systems Training 
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Model consists of two components. (1) Identification of goals and (2) 
Development of a plan. The soundness of the products of these compo- 
nents is continuously evaluated in their developmental stages by a pro- 
cess known as formative evaluation. These products are synthesized 
to formulate training packets. The term "Developmental Subsystem" used 
here is intended to mean a system which affects the delivery of a usa- 
ble product. It is the design process of the training model. Its 
function is to generate, from the content base, appropriate training 
packets. These training packets are designed to become important train- 
ing resources for user agencies. 

Identification of Goals : The products of the component of this De- 
velopmental Subsystem are written to correspond to training items in the 
content base. Each goal is written so that its acheivement by the 
trainee is observable. Goals are sequenced and differentiated accord- 
ing to degrees of competency required for the various roles and functions 
which the trainee assumes and performs as a practicing professional. 
Goals represent what the trainee will be able to do, or the knowledge he 
will possess, after having mastered the training packet. Goals also tell 
what the user can look for as evidences of success after the training 
packet has been implemented. Finally, goals are sequenced to enable the 
user to employ only thosa which are deemed usable for a partular train- 
ing purpose. 

Development of a Plan : The training packet involves a variety of 
materials and procedures. This necessitates a detailed plan involving 
multiple documents. A complex training packet is delineated in a variety 
of outlines and manuals of procedures. The plan tells what must be done 
to accomplish specific goals. Very little planning is left to on-the 
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scene development and decision once the training packet is utilized. All 
elements and subelements of the training packet are preplanned in great 
detail. Detailed plans aid in the analysis of all aspects of the train- 
ing packet and the identification of prospective weak spots. Plans are 
written so that the user of the training packet will easily understand 
and be able to put it into operation without assistance* 

Formative Evaluation ; The development of a plan mentioned above 
includes a description of how each goal in the plan will look when the 
training packet is actually implemented. Each goal is tied to a specific 
description of its operation in the plan. This description serves as the 
basis for the formative evaluation of the training packet. Formative 
evaluation is the act of considering the effectiveness of the plan before 
and during field testing of a training packet before dissemination to 
user agencies. The formative evaluation component of the Developmental 
Subsystem is the mechanism whereby the successful design of a training 
packet is assured. The goals of a training packet are checked against 
the plan to ascertain that there exists a logical and sensible expectation 
for the successful use of the training packet. 

Evaluation Subsystem 

The final subsystem of the Systems Training Model is the Evaluation 
Subsystem. The Evaluation Subsystem provides summative Information use- 
ful in revising the training packet. Summative evaluation is an attempt 
to measure the usefulness and worth of the training packet as viewed 
from the user's perspective. Solicited feedback 1s subjected to summative 
evaluation which gives the necessary guidance for determining the nature 
of revisions to the training packet. The revision process modifies the 
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training packet to reflect the input of recent summative data as it 

becomes available from the user agencies in the field. 

Summary 

The Systems Training Model just described integrates both Infor- 
mation and Developmental Subsystems in order to facilitate the con- 
struction of competency-based training packets in order to increase 
the skills and knowledge of trainees. The purpose of the Information 
Subsystem is to generate training content from various informational 
resources. The Developmental Subsystem is unique in that it provides 
training packets which are adaptable to individual, small and large 
group use. It must be remembered, however, that the feasibility, not 
to mention the worth, of packaging cognitive and affective experiences 
for use as training content remains largely untested. The Systems 
Training Model provides the structure for testing the feasibility 
of providing innovative and effective training packets. The Eval- 
uation Subsystem characterizes the recursive nature of the Systems 
Training Model. It is the mechanism which should assure effective 
training packets. 
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